Papers by Pranay Kumar Yelugam
DISAPERE: A Dataset for Discourse Structure in Peer Review Discussions (2022.naacl-main)
Copied to clipboard
Neha Kennard, Tim O’Gorman, Rajarshi Das, Akshay Sharma, Chhandak Bagchi, Matthew Clinton, Pranay Kumar Yelugam, Hamed Zamani, Andrew McCallum
| Challenge: | Prior work on labeling arguments extracted from peer review text has focused qualified labor force on labelling arguments extracted by the text. |
| Approach: | They synthesize label sets from prior work and extend them to include fine-grained annotations of review and rebuttal sentences. |
| Outcome: | The proposed dataset synthesizes label sets from prior work and extends them to include fine-grained annotation of review and rebuttal sentences. |
Every Answer Matters: Evaluating Commonsense with Probabilistic Measures (2024.acl-long)
Copied to clipboard
Qi Cheng, Michael Boratko, Pranay Kumar Yelugam, Tim O’Gorman, Nalini Singh, Andrew McCallum, Xiang Li
| Challenge: | Existing commonsense evaluations are often posed as multiple-choice questions, allowing models to exploit systematic biases. |
| Approach: | They propose a generative task that evaluates common sense via multiple open-ended generations and a method that strongly correlates with human judgments. |
| Outcome: | The proposed method outperforms strong language model baselines on a dataset of human and machine common sense. |